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(54) World wide web news retrieval system 

(57) A World Wide Web site data retrieval system 
includes an input device for inputting data and com- 
mands to access the World W»de Web, and a memory 
for storing a Web site data retrieval driver which 
includes a Web reader, stored Web site address Infor- 
mation, stored Web site commands, and stored format 
information. The memory also stores process steps to 
connect to a Web site and to issue commands within the 
connected Web site, and a connection to the World 
Wide Web. The system includes a processor for launch- 
ing the Web site data retrieval driver in response to a 
command to access the World Wide Web. The Web site 
retrieval driver, upon being launched. (1) launches the 



Web reader to connect to the World Wide Web via the 
connection. (2) retrieves the Web site address informa- 
tion and Web site commands, (3) Instructs the Web 
reader to access the Web site based on the Web site 
address information and Web site commands. (4) down- 
loads Web site data from the Web site based on the 
Web site commands. (5) stores the Web site data in a 
linear document. (6) repeats steps 1 through 5 until all 
addresses In the stored Web site address information 
have been accessed, and (7) formats the linear docu- 
ment into a personalized document based on the fornat 
information. 
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Description 

BACKGROUND OF THE INVENTION 
5 Field Of The Invention 

The Invention relates to a data retrieval system which automatically traverses hypermedia documents on a compu- 
ter network and automatically retrieves information from those documents based on a match tjetween the structure of 
the documents and a personalized data retrieval structure. More particularly, the invention can retrieve articles from a 

10 news service, from a magazine service, or from a combination of both services which are located on the World Wide 
Web, a private computer network that supports hypermedia links, or any other hypermedia-linked computer system. 

For example, there exists a Web site for retrieving news articles from the New York Times and a Web site for retriev- 
ing articles from People magazine. The retrieval system of the invention can traverse through such Web sites and select 
articles based on a personalized data reti-ieval structure. The personalized data retrieval structure may include com- 

15 mands to retrieve a full text of the front page only, headlines of the business section, headlines of the slock section and 
sports section, etc. In addition, tiie personalized data retrieval structure may include content-based rules to retrieve arti- 
cles wiUi certain keywords, to exclude articles with certain keywords, or to include articles based on a rule-based con- 
tent analysis. The invention also provides a method for synthesizing all retrieved news articles and printing tfie 
syrrtiiesized news articles into a newspaper-type format in which each of the articles is arranged teased on a user's pre- 

20 defined layout. 

While the above example is in the context of the Web. hypermedia documents can reside on other types of net- 
works besides the Web. such as an intranet. An intranet is a private computer network that is not connected to outside 
conrputer networks. For example, a company's own conrpuler network couW be an intranet with hypermedia documents 
on it. For brevity, tiie following discussion is made with respect to the World Wide Web. However, it should be under- 

25 stood tiiat the invention applies equally well to any type of computer network that contains hypermedia documents, 
such as an intranet different hypenmedia-linked computer networks tiiat reside on tiie Internet other tiian the Web, etc. 

A hypermedia document on the Web can span multiple Web sites. Such documents can be newspapers, news arti- 
cles, magazines, catalogs, manuals, memoranda, and the like. For brevity, the following discussion is made with respect 
to sources of news information. However, it should be understood ttiat the invention applies equally well to any other 

30 type of hypermedia document. 

Description Of The Related Art 

The WorkJ Wide Web is an on-line source of hypermedia documents containing hypermedia text and images that 
35 act as links to other documents. Web sites, etc. As a result, documents on ttie Web are not organized sequentially. 
Rather, a user is automatically linked to other documents or Web sites to complete ttie viewing of a document by select- 
ing a hypermedia link, such as a text link or an image link, witiiin tiie document Accordingly, an entire document cannot 
be viewed by saolling tiirough text. 

One popular i^e of the Web is on-line publication and distribution of magazines and newspapers. Currentiy, many 
40 Web news services, such as tiie New York Times, allow tiie user to define keywords of interest and to receive news 
information, daily or hourly, that contains text matching tiie keywords. The news information can then be delivered to 
the user's computer via modem or E-man. However, most Web news site newspapers, like the New York Times, include 
too much information, most of which has no interest to tiie user since the information is retrieved based only on a key- 
word match. 

45 Otiier sources of news infomiation are provided ttirough information suppliers like "^Individual Inc." Individual Inc. 
supplies users with a brief summary of the top twenty most relevant articles based on a user's predefined keywords. 
This subscription news service allows tiie user to specify five to ten areas of interest based on keywords, which are then 
prioritized by tiie user. The information service searches the Web for magazines and newspapers which contain any of 
tiie keywords. Based on tiie keyword searches, twenty of the most relevant articles are selected, compiled Into a brief 

50 one-page summary, ard transmitted to ttie user via facsimile for ttie user's review. However, in order to review an entire 
document rather than tiie summary, tiie user must log onto a specific Web site containing tiie document in order to 
retrieve and review the document 

There are yet otiier services which permit the user to personalize a newspaper to be displayed at the user's termi- 
nal by storing links to various news articles from various news sources on tiie Web. For example, CRAYON "Create Your 

55 Own Newspaper" permits a user to select specific sections from among links to over twenty-five different on-line news- 
papers, and to compose ttie selections into a personalized newspaper. Using CRAYON, it is possftjie to compose a per- 
sonalized newspaper containing, for example, links to the international section of the New York Times, the business 
section of ttie Wall Stireet Journal, and ttie sports section of ttie Chicago Tribune. The HTML (hypertext markup lan- 
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guage) source file for this newspaper is then stored to mass media storage for later use. 

While the forgoing news and infornnation services provide convenient ways to keep updated on the news, they do 
not allow a user to access and view the news in the way that people naturally read a real-world newspaper. Namely, 
people naturally read a newspaper by scanning the pages of sections that they find interesting and then reading those 

5 articles that grab their attention. In other words, people use a structural approach to decide what pages to look at ini- 
tially (e.g.. the first page of the Business and World sections, and the comics page of the Arts section). They then scan 
the selected pages for articles. 

In sum. conventional news and information services do not allow a user to access data from a hypermedia docu- 
ment on tiie basis of the structure of ttie document, and then to format that data in a manner tiiat allows the user to scan 

10 and read the data in a natural fashion. 

SUMMARY OF THE INVENTION 

In accordance with one aspect the invention addresses the above deficiencies in the art by accessing at least one 
15 hypermedia document, retrieving data from the hypermedia document into an extracted data tree, with the data 
retrieved based on a structure of the hypermedia document, flattening ttie extracted data tree into a linear document, 
and formatting the linear document into a fornnatted document. 

in another aspect, the invention creates a personal-news-proflle for retrieving data from a hypermedia-linked com- 
puter network. The hypermedia-linked connputer network is accessed, a learning nxxJe is started, the hypermedia- 
20 linked computer network is traversed with commands, at least one rule is extracted from tiie commands, and the rule(s) 
is compiled into the personal-news-profile. 

In yet another aspect, the invention creates a personalization profile for a Web site retrieval data retrieval system. 
Data and connmands are input to access the WorkJ Wide Web and a connection is made to the WorkJ Wide Web. A Web 
reader is launched, and the Web reader accesses the Web via the connection. In response to user commands, a learn- 
25 ing mode is entered into. Commands are sent to traverse the World Wide Web. and at least one rule Is extracted from 
the commands. The rule(s) is compiled into a personalization proffle. which is stored. 

In yet another aspect, the invention retrieves articles from a hypermedia-linked computer network and formats tfie 
articles into a personalized newspaper. A stored personal-news-profile is retrieved. The personal-news-profile includes 
address data for a site on the hypermedia-linked computer network, command data for accessing data from the site. 
30 and newspaper layout commands. The site is accessed based on address data stored in the personal-news-profile, and 
articles at the site are downloaded based on command data stored in tine personal-news-profile. The downloaded arti- 
cles are flattened into a linear document, and the linear document is formatted into the personalized newspaper accord- 
ing to newspaper layout commands stored in the personal-news-prdile. 

In yet another aspect, the invention retrieves data from a World Wide Web site and formats tiie data into a person- 
35 alized document A Web site data retrieval driver which Includes a Web reader, stored Web site address information, 
stored Web site commands, and stored fomial information is accessed. The invention (1) launches the Web reader to 
connect to the WorW Wkie Web via a connection to the Web. (2) retrieves the Web site address information and Web 
site comn^ands, (3) instiucts the Web reader to access tiie Web site based on the Web site address information and 
Web site commands, (4) downloads Web site data from the Web site based on ttie Web site commands, wherein the 
40 data is downloaded witfi reference to a linked list so as to avoid hypermedia-links tiiat form loops and so as to avoid 
repetitious downloading of data that has already been downloaded, (5) stores the W^ site data in a linear document, 

(6) repeats steps 2 through 5 until an addresses in the stored Web site address information have been accessed, and 

(7) fonnats the linear document into the personalized document based on the format information. 

In yet another aspect, the invention accesses and retrieves data at World Wide Web sites and formats tiie data into 
45 a personalized document. The invention connects to the World Wide Web. retrieves user defined Web site address 
infomiation, user defined Web site commands, and user defined formatting commands, and activates a Web reader so 
as to access a Web site based on the user defined Web site address information. The Web reader is used to download 
data from the Web based on the user defined Web site commands, and the data is downloaded into an extracted data 
tree. The downloading continues until an addresses in the user d^ined Web site address information have been 
50 accessed. The extracted data tree is flattened into a linear document, and tiie flattened document is formatted into the 
personalized document based on the user defined formatting commands. 

In yet another aspect, the invention retrieves news articles from on-line news services on the World Wide Web and 
formats the news articles into a personalized newspaper. The inventfon stores a personal-news-profile which comprises 
addresses data and command data for accessing data from a Web site and newspaper format commands, retrieves the 
55 stored personal-news-prof He and accesses tiie data stored therein, activates a Web reader to contact a Web site based 
on address data stored in the personal-news-profile, downloads news articles at the contacted Web site based on com- 
mand data stored in the personal-news-profile, stores the downloaded news articles, and formats the stored news arti- 
cles into the personalized newvspaper based on the newspaper format commands stored in tiie personal-news-profile. 
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In yet another aspect, the invention formats a hypermedia document into a personalized document. A location of 
the hypermedia document is spedf ied, a type of the hypermedia document Is specified, a scope of data to be retrieved 
from the hypermedia document is specified, wrherein the scope is based on a structure of the hypermedia document, 
and a format is specified for formatting the data retrieved from the hypermedia document into the personalized docu- 
ment. The hypermedia document found at the specified location Is accessed, data is retrieved from the hypermedia 
document in accordance with the specified hypermedia document type and in accordance with the specified scope, and 
the data is formatted into the personalized document in accordance vwth the specified format. 

In yet another aspect, the invention is a system for processing a hypermedia document. The system accesses the 
hypermedia document, extracts addresses from the hypermedia document and stores the addresses extracted from 
the hypermedia document in a container. The system activates a processing function to process data stored at the 
addresses stored in the container, downloads the data stored at the addresses stored in the container into a memory, 
and extracts predetermined data from downloaded data in accordance with predetermined configuration infomiation. 
The predetermined data is then formatted in accordance with predefined formatting settings to generate a fomiatted 
document, and the formatted document is processed in accordance with the processing function. 

In prefen-ed embodiments, the system inputs the formatting settings and configuration information via a graphical 
user interface. The graphical user interface comprises plural processing icons, one of which activates tiie processing 
function. By virtue of the graphical user interface, a user can interactively set a document's format and change that for- 
mat should a change be desired. 

In particularly prefenred embodiments, the graphical user interface is displayed in plural modes. The plural modes 
comprise (1) a fully-functional mode in which the graphical user interface displays formatting fields, processing options, 
menus and the processing icons, and (2) a minimizing mode in which the graphical user interface displays only the 
processing icons. Typically, the graphical user interface displayed in the minimizing mode isdi^layed during browsing 
the hypermedia document. By displaying the graphical user interface in plural modes, the present invention facilitates 
operation of the invention during browsing of the hypermedia documertl. 

This summary has been provided so that the nature of the invention may be understood quickly. A more complete 
understanding of the invention can be obtained by reference to the following detailed description of the preferred 
enrijodiments thereof in connection with the attached drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Rgure 1 is a perspective view showing the outward appearance of the personal news retrieval system according to 
an embodiment of the invention. 

Figure 2 is a block diagram of the personal news retrieval system shown in Figure 1 . 

Rgure 3. comprised of Rgures 3A. SB, 3C and 3D, shows representational diagrams illustrating an example of the 
transformation of information from the Web (Rgure 3A) to an extracted data tree (Rgure 3B). then to a flattened docu- 
ment (Figure 3C). and finally to a formatted document (Rgure 3D) according to an embodiment of the invention. 

Rgure 4 is a representational block diagram of the manner by which a personal-newsiDrofile for retrieving news 
articles via the Web is created or edited according to an embodiment of the invention. 

Rgure 5, comprised of Figures 5A and 5B. shows flow diagrams describing how a personal-news-profile Is created 
or edited. 

Rgure 6 is a representational block diagram of the manner by which news articles are retrieved from the Web and 
formatted with reference to a personal-new-profPe according to an embodiment of the invention. 

Rgure 7 is a flow diagram describing how news articles are retrieved from tiie Web with reference to a personal- 
news-prcfile. 

Figure 8 is a flow diagram showing how retrieved news articles are formatted with reference to a personal news pro- 
file and sent to a print device interface. 

Rgures 9A to 9E depict a graphical user interface used with the second embodiment of the present invention. 
Rgure 10 is a flow diagram describing the operation of the second embocfiment of the invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

Rgure 1 is a view showing the outward appearance of a representative embodiment of the invention. Shown in Fig- 
ure 1 is computing equipment 1, such as a Macintosh or an IBM PC or a PC-compatible computer, having a windowing 
environment, such as Microsoft Windows. Provided witti computing equipment 1 is display screen 2, such as a color 
monitor or a monochromatic monitor, keyboard 3 for entering text data and user commands, and a pointing device such 
as nrouse 4 for pointing and for manipulating objects displayed on display 2. Computing equipment 1 also includes a 
mass storage device such as disk drive 5. Image data can be input into computing «juipment 1 from a variety of 
sources such as a network interface 11a or from external devices via facsimile^modem interface 6. Network interface 
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1 1 a is used to connect computing equipnnent 1 to a local area network (LAN) or to a wide area network (WAN) such as 
the World Wide Wetx 

Figure 2 is a detailed block diagram shewing the internal construction of computing equipment 1 . As shown in Rg- 
ure 2, computing equipment 1 includes central processing unit (CPU) 8 interfaced with computer bus 9. Also interfaced 

5 with computer bus 9 is printer interface 1 0. fax/modem interface 6, display interface 1 1 , network interface 1 1 a. keyboard 
interface 12» mouse interface 13, main memory 14, and disk drive 5. 

Main memory 14 interfaces with computer bus 9 so as to provide random access memory storage for use by CPU 
8 when executing an application such as personal-news-profile editor 16 or Web printer 17. More specif icaily, CPU 8 
loads these software applications from disk drive 5 into main memory 1 4 and executes the software applications out of 

10 main memory 14. In accordance with user instructions, stored application programs are activated which permit 
processing and manipulation of data. Typically, the software applications stored on disk drive 5. such as personal-news- 
profile editor 16, Web printer 17, and HTML formatter 18, have been stored on disk drive 5 by downloading the software 
applications from a computer-readable medium such as a floppy disk or CD ROM. or by downloading the software appli- 
cations from a conrputer bulletin board. 

IS Disk drive 5 stores data files which can include text fOes and image files, in compressed or uncompressed format, 
and stores software application files such as those noted above. The software application files include Windows appli- 
cations, DOS application, and personal news retrieval files 15. Personal news retrieval files 15 include personal-news- 
profile editor 16. Web printer 17. HTML formatter 18, personal-news-profile(s) 19. and site profile(s) 20. The detailed 
functions of personal news retrieval files 15 will be discussed below, after a brief overview of the operation of the per- 

20 sonat new retrieval system. 

Overview of Docum ent Retrieval 

Rgure 3, connprised of Rgures 3A to 3D, illustrates the operation of a representative embodiment of the inverrtion. 
25 Figure 3A is a graphical representation of a typical Web site 21 with news information contained therein. Within Web 
site 21 is homepage 22 with links to indices such as headings 23, which are in turn linked to articles 24. Some of articles 
24 are linked to other articles. As article H 26 reskJes on anotiier Web site, link 25 is a cross-site link. Unk 25 illustrates 
how a single hypemiedia document, represented by homepage 22, can traverse multiple Web sites. 

In order to retrieve news from W^ site 21 . the invention first traverses Web site 21 to retrieve data according to 
30 user-deJined rules. As will be discussed in more detail b>elow, these rules can be based on tiie structure of Web site 21 , 
or on the structure of Web site 21 and its contents. The data is retrieved into an extracted data tree, which preserves 
the organization of the data as shown in Rgure 3B, but in which some links are excluded. 

The organization of extracted data tree 27 has several features. Rrst, extracted data tree 27 has root 28 which can 
have child nodes for one or more sites 29, which in turn can have index nodes 30 which correspond to indices/headings 
35 23. articles nodes 31 , and the like. Second, extracted data tree 27 is a true tree, with no loops (i.e.^ cyclic patiis) ttierein. 
For example. Rgure 3A shows a loop from homepage 22 to index node #1 , to article C, and tfien back to homepage 22. 
This loop is removed when aeating extracted data tree 27. 

Second, the organization of exti^cted data tree 27 depends on how tiie Web sites are traversed, and not on the 
Web sites' actual layouts. Thus, article H 26 appears under index node #3 (under srte #1), indicating that the news 
40 retrieval system accessed article H 26 from site #1 via cross-site link 25. 

Rnally, as noted eariier, certain articles have been excluded from extracted data tree 27 due to the structure of Web 
site 21 or possibly a content of indices/headings 23 and articles 24. For example, artteles E and G have been excluded 
from extracted data tree 27. 

According to this embodiment of tiie invention, extracted data tree 27 is flattened into linear document 32. as shown 
45 in Rgure 3C, possibly witii reference to nrrore exclusion rules. Linear document 32 is sinply a continuous document witii 
information from extracted data tree 27 embedded therein. 

Rnally. linear document 32 is formatted according to user-specified (or default) formatting instructions Into format- 
ted document 33. shown as a stylized personal newspaper in Rgure 3D. Fomnatted document 33 has various fonts 
and/or colors for site labels, indices/headings, articles, and the like. Furtiiennore, formatted document 33 is broken 
50 down into pages. 

Note ttiat in alternate embodiments of the news retrieval system, certain stages of the above transformation from 
Web site 21 to fomnatted document 33 can be skipped. For example, data from Web site 21 can be retrieved directiy 
into flattened docun^ent 32, as long as a record of the organization of the data is maintained (FX)ssibly in a separate 
linked list) so as to avoid downloading the same article twice and so as to avoid loops in the organization of Web site 
55 21 . Alternatively, extracted data tree 27 can be directly formatted into formatted document 33. In any case, the basic 
operation of the invention remains the same: the news retrieval system traverses a hypenmedia document on ttie Web, 
extracts data according to user-defined irribrmation, and formats the data into a personalized newspaper. 

As mentioned in the above discussion, various user-defined rules and other information (such as formatting infbr- 
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mation) are involved in the news retrieval process. That user defined information is stored in personal-news-profile(s) 
19, the definition of vifhich is desatbed next 

Pgfinipg a Pgrgopal'Neytfs-Profile 

5 

Figures 4 and 5 illustrate the process by which personal-newsijrof ile 19 is defined. To aeale personal-news-profile 
19, personal-news-profile editor 16 communicates with personal-news-profile 19, site profile 20, and Web reader 34. 

Personal-news-profile 19 contains information as to what sites to access for creating a personalized newspaper, 
what sections to retrieve from those sites, rules to be used to determine wrhat data to extract from the sections and the 

10 articles therein, rules to determine how to exclude links, and newspaper format information. A sample personal-news- 
profile is shown in Appendix 1. 

Site profile 20 includes general site information that is not specific to a particular user. For example, site profile 20 
could contain information such as full site addresses, sections within a site, non-user specific passwords, etc. Sample 
site profiles are shown in Appendix 1 . Because general site information is stored in site profile 20, personal-news-profile 

15 19 can refer to the general site information with reference to site profile 20, saving space in the personal-news-profile. 
For example, as shown in Appendix 1. personal-news-profile 19 can refer to a site number 1. Site profile 20 indicates 
that site number 1 is the "San Jose Mercury News," with a homepage at "http//www.sjmercury.comr. This construction 
also centralizes general site information. Thus, if a site address changes, only site profile 20 needs to be changed to 
update all personal-news-profiles 19 on the system. 

20 Web reader 34 is an application program or program module that communicates with the Web via Web server 35. 
In response to commands from personal-news-profile editor 16. Web reader 34 will access the Web, traverse hyperme- 
dia documents on the Web, retrieve data from the documents, and return the retrieved data to personal-news-profile 
editor 16. 

As shown in Figure 4. personal-news-profile editor 16 includes four modules: site driver 36, Web reader interface 
25 37. profile manager 38, and format editor 39. 

Web reader interface 37 interfaces personal-news-profile editor 16 to Web reader 34. Site driver 36 interacts with 
Web reader 34 via Web reader interface 37 to provide an abstract interface to each individual Web site. More specifi- 
cally, site driver 36 instructs Web reader 34 to access various Web sites and to retrieve data from those sites. Thereaf- 
ter, site driver 36 receives that data and builds site profile 20 therefrom. The date can also be used to update an existing 
30 site profile. 

In building site profile 20, site driver 36 translates the structure of each accessed Web site to a uniform structure 
defined in site profile 20, and stores data retrieved therefrom in site profile 20. By translating different Web sites, some 
of which may have different structures, into a single uniform structure and storing data therefrom in that structure in site 
profile 20, the present invention fadlitates access to information from different Web sites, and thus reduces overall 
35 processing time. 

Profile manager 38 maintains document templates tiiat specify how to format a personalized newspaper. Prede- 
fined document tenplates exist. In addition, format editor 39 allows a user to specify personalized tenplates for format- 
ting a newspaper, either by editing existing templates or by creating new ones. In any case, each document template 
specifies page layout infonmation, font information, style information, colors, etc. for the titles, indices/headings, sub- 

40 headings, text and the like for a personalized newspaper. 

Sanple code for personal-news-proffle editor 1 6, site driver 36, and profile manager 38 is included in Appendix 3A. 
Rgures 5A and 5B are flow diagrams describing the operation of personal-news-profile editor 16 in more detail. 
Figure 5A shows the operation of personal-news-profile editor 16 in defining the parts of personal-news-profile 19 relat- 
ing to accessing Web sites and retrieving data from those sites. 

45 In step S500 of Figure 5A, personal-news-prof Be editor 1 6 is launched by a user. In step 8501 , the editor launches 
Web reader 34. The user's personal I.D. is then retoieved in step S502. If a personal-news-profile already exists for that 
I.D., step S503 directs flow to step S504, where tiie user is given the option of skipping to tiie format editor. Otiienwise, 
personal-news-profile editor 16 enters a "learning mode" in step S505. Once in the learning mode, personal-news-pro- 
file editor 16 proceeds to step S506, where it accepts a Web command (i.e., a command to traverse a hypermedia link) 

50 from the user and fbnwarcte the Web command to the Web reader by means of site driver 36. Site driver 36 maintains a 
hierarchical log of Web sites visited by Web reader 34. In step S507. personal-news-profile editor 1 6 creates an extrac- 
tion rule from tiie Web command. This rule will allow the news retrieval system to later duplicate the user's selection 
criteria in browsing (clicking on hyperiinks within) a Web site. 

The rule specifies, at the least, structural criteria for duplicating the traversal of the Web site. For example, if a user 

55 accesses all articles under a particular index/heading, the rule will specify ttiat all articles under that index/heading 
shouki be retrieved. 

In one embodiment of the inv^rtion, the rule can also include content-based criteria (i.e.. keyword-based crrteria) 
accepted from the user. These content-based rules can. for exanple: (1) require certain words to be in an article, (2) 
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exclude articles with certain words, (3) require certain boolean combinations of words, (4) rank articles that are selected 
based on structural crtteria, with the ranking based on keywords, and then require the selection of the articles with the 
highest ranking(s), or (5) exclude certain types of articles such as advertisements. 

Examples of the syntax for the structural and content-based exclusion rules are shown in Appendix 2. Several dif- 

5 ferent types of rules are shown. Some simply limit the traversal of a Web site to a certain number of links. Others are 
date and keyword based exclusion rules. One particularly flexible rule indicates that articles should be ranked based on 
a keyword analysis and the top scoring articles should be chosen. Otiier rules include *1iattening" rules. These rules 
control the flattening of the extracted data tree, as will be explained in more detail below. 

At the least tiie rule includes structural information about the user's selection (i.e., first page, first document, all 

10 links, etc.), necessary password information, browser commands, and the like. The rule can also include a pointer or a 
reference to site profile 20 and the appropriate information therein. General (non-user specific) information is used by 
site driver 36 to maintain site profile 20. In this manner, address infbnmation and passwords common to multiple users 
can be maintained in site profile 20, as discussed above. For example, site driver 36 will store commands or hyperlinks 
to other documents in a Web page in the mie, but will not store a Web site's full address in tiie rule. That address infor- 

75 mation is stored in site profile 20. 

In step S508, rule data defining the rule aeated from a Web command(s) is stored in an extracted data tree such 
as extracted data tree 27 in Rgure SB. This data tree is a linked list that reflects the organization of the data retrieved 
from the Web. In step S509. flow returns to step S506 for the next Web command unless the user is done (i.e., the user 
signs-off the Web site), in which case f tow proceeds to step S510. 

20 At tills point the aeation of the personal-news-profile has proceeded much like the creation of a macro common 
to word processing programs, except tiiat site profile 20 has been used to minimize storage requirements and to cen- 
tralize general site information. In order to minimize storage requirements further and in order to make tiie news 
retrieval system more flexible and efficient the extracted rules are now compiled to remove redundant links, multiple 
visits to the sarne site, and the like. This occurs In step S510, and tiie resulting compiled rules become the first part of 

25 personal-news-profile 19. 

Alternatively, personal-news-profile editor 16 may be invoked as a graphical user interface which allows a user to 
edit a previously stored personal-news-profile or to specify document composition preferences, for example, by speci- 
fying news sites, headline articles only, keywords, etc. In either case, the result is personal-news-profile 19, which com- 
prises a fisting of Web site pointers as well as extracted rules for traversing through a Web site or sites. 

30 For a better understanding of tiie atx3ve, sample personal-news-profiles and sample site profiles are provided in 
Appendix 1 as noted above. 

Next operation proceeds to give the user an option to modify a custom newspaper tenrplate, as shown in Rgure 
5B. In step S511. It is determined if a newspaper template has been defined and stored in personal-news-prof lie 19. If 
a newspaper template has been defined, step S51 2 gives tiie user tiie option to edit tiie template or to proceed to step 
35 S520. If the user chooses to edit tiie template or if no newspaper template has been defined, flow proceeds to step 
S513. 

Step S51 3 gives the user the option of aeating a custom template or using a predefined template. If tiie user wants 
to use a predefined tenplate, step S514 gets the specified predefined template, which Is added to the personal-news- 
profile in step S519. Othawise, flow proceeds to step S515, where format editor 39 is invoked. 

40 Format editor 39 has a graphical user interfece that provides the user with a number of formatting options. In step 
S516, fonrmt editor 39 allows tiie user to define which newspaper sections are to be printed in tiie newspaper, which 
Web site's news article are to be placed in each section, and/or how each page is to be laid out In this regard, the user 
can specify which Web site's news articles are to be used as a front page, which Web site's news articles are to be used 
as a business page, which Web site's news articles are to be used as a sports page. etc. In addition, in step S516, tiie 

45 user can define where each index/heading should be listed, as well as what sub-headings should go on each page. 

In step S517, format editor 39 allows the user to define tiie font styles for indices/headings, sut}-headlngs, bylines 
and actual text of news articles. In step S518. format editor 39 prompts the user to define index/heading colors, title 
colors, etc. In this regard, layout editor 39 is capable of determining the types of fonts and colors available to the user 
based on the system's printer capabilities. 

50 Once all of the information is gatfiered for the custom template, tiie format editor adds the information to personal- 
news-profile 19 in step S519. Alternatively, profile manager 38 may also store the custom format as a template In a 
common area for use by other users. In tiiis case, only a pointer or reference to the custom tenplate is stored in per- 
sonal-news-profile 19. 

In step S520. personal-news-prof ite editor 16 prompts tiie user to set an automatic newspaper delivery time and 
55 method (i.e., prim or store on disk drive 5 for later printing). These settings are added to personal-n 19. More 

specifically, in tiie case that a user's computer is continuously supplied with power, tiie Web news retrieval system can 
be launched automatically at a designated time. The system will retrieve articles from the Web sites which are listed in 
personal-news-prof ite 1 9. Upon retrieving tiie news articles, the articles will be formatted based on the newspaper tem- 
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plate in personal-news-profile 19. The formatted personalized newspaper can then be either printed or stored for later 
viewing. In the case that a time is not set for newspaper delivery, the user can execute the Web news retrieval system 
program at any time. 

Once personal-news-profile 19 has been created, the Web news retrieval system, upon being launched, can 
traverse Web news sites and build a personalized newspaper by autcwnatically retrieving various news articles from the 
Web news sites and print the news articles based on the newspaper template indicated in personal-news-profile 19. A 
description of how the Web news retrieval system of the invention performs this function is described next 

Retrievino a Document Usino a Personal-News-Profile 

Rgure 6 is a representational block diagram of the manner by which the invention retrieves articles from the Web 
according to personal-news-profile 1 9. (Figure 6 also shows the manner by which the retrieved articles are flattened into 
a linear document and formatted. These functions are discussed in greater detail in the next section of this application.) 

As shown in Rgure 6, Web printer 1 7 is responsible for retrieving news articles. Web printer 1 7 is an end-user appli- 
cation that communicates with personal-news-profile(s) 19. site profile 20, Web reader 34, and output interfece 40 in 
order to perform this function. 

Web printer 1 7 looks at personal-news-profile 1 9 to determine which Web sites to access and which data to retrieve 
from those sites. Web printer 17 also looks at site profile 20 for general site information. According to the information in 
personal-news-profile 19 and site profile 20, Web printer 17 instructs Web reader 34 to connect to the Web via Web 
sender 35 in order to access various Web sites and to retrieve data from those sites. Web reader 34 sends the retrieved 
data to Web printer 1 7, and Web printer 1 7 uses the data to buiW an extracted data tree. As will be discussed in greater 
detail in the next section of the application, Web printer 17 then flattens the extracted data tree into a linear document 
and formats the linear document for output via output interface 40. 

As shown in Rgure 6, Web printer 1 7 includes four program module: Web reader interface 50, site driver 51 , tree 
manager 41, and formatter 42. 

Web reader interface 50. like Web reader interface 37 described above, interfaces Web printer 17 to Web reader 

34. 

Site driver 51 accesses site profile 20 and personal-news-prof fle 1 9 and provides data stored therein to W^ reader 
34. As noted above. Web reader 34 uses that data to access various Web sites and to extract data therefrom. As noted 
above, this retrieved data is used by Web printer 37 to build an extracted data tree. 

Tree manager 41 manages the extracted data tree. In this regard, tree manager 41 keeps track of the organization 
of the retrieved data In the extracted data tree. This alicws Web printer 17 to avoid accessing the same article twice, to 
avoid unnecessarily re-visiting a Web site, and to avoid getting caught in a cycle (loop) in the organization of a hyper- 
media document on the Web. Altematively, tree manager 41 couW store the data in blocks (as opposed to directly in a 
data tree) with reference to a linked list that provides the same functionality as the extracted data tree. Sample code for 
tree manager 41 is included in Appendix 3B. 

Fomnatter 42 is responsible for flattening the extracted data tree into a linear document and formatting the linear 
document into a personalized newspaper. Formatter 42 performs these functions in accordance with the print criteria 
and fonnat infonmation (i.e., newspaper template) indicated in personal-newsiDrofile 19. Sample code for formatter 42 
is included in Appendix 3B. 

In more detail, Rgure 7 is a flow diagram describing how Web printer 1 7 uses Web reader 34 to traverse the Web 
accading to personal-news-profile 19 and to retrieve articles from the Web according to the profile, excluding unwanted 
data. 

The Web printer starts in step 8700. In step S701, Web printer 17 retrieves either a user designated personal- 
news-profile or a default personal-news-profile stored in disk drive 5 using site driver 51. In this regard, because com- 
puter equipment 1 may be used by more than one user, there may be one or more personal-news-profiles stored on the 
equipment, one of whfch will be designated as the default. Upon retrieving the designated personal-news-profile, in step 
8702 Web printer 17 determines whether any news data has Ijeen previously stored to disk drive 5 (for example, by a 
previous automatic news delivery) or if news articles shoufcJ be retrieved using personal-news-profile 19. 

In the case that news data does exist on disk drive 5. In step S703 the stored news data is retrieved and f fow pro- 
ceeds to step 8801 of Rgure 8, discussed in more detail in the next section. On the other hand, if no stored news data 
exists. Web printer 17 invokes Web reader 34 in step S704. Note that this is the same Web reader 34 as discussed 
above with respect to defining a personal-news-profile. 

Upon being invoked, Web reader 34 connects to Web server 35 in step 8705, which provides a connection to a net- 
work, such as the Work! Wide Web. Web printer 17 then provides Web reader 34 with an address for the first Web site 
to be visited based on information retrieved from personal-news-profile 19. Once connected to the desired Web site in 
step 8706, Web printer 17 provides Web reader 34 with commands/links for traversing the Web to the next Web page 
containing information that personal-news-profile 19 indicates should be retrieved. Web reader 34 traverses the Web 
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according to this information in step S707. 

In step S708. Web reader 34 retrieves the desired information and sends it to Web printer 17 according to the rules 
in personal-news-profile 19. Thus, data exclusion occurs in this step. The rules in personal-news-profile 19 specify 
structural and content-based criteria for excluding data from the personalized newspaper. The structural rules limit the 

5 retrieved inforhnation on the basis of the structure of the Web site accessed by Web reader 34. The content-based rules 
limit the retrieved information on the basis of its content. As mentioned above with respect to creating a personal-news- 
profile, examples of the syntax of the retrieval rules in personal-news-prof fle 19 are included in Appendix 2. 

In addition to rule-based exclusion, media-type exclusion occurs in step S708, wherein data of a media type that 
can not be printed is excluded from the extracted data tree. For example, movie and sound data can be excluded. 

10 Web printer 1 7 stores the retrieved data in disk drive 5 (or in main memory 14) m the extracted data tree managed 
by tree manager 41 . Alternatively, the data could be stored in blocks with reference to a linked list as discussed earlier. 
In st^ S709. Web printer 17 returns to step S707 to conplete retrieving all information from Web pages at the Web 
site. In step S710, upon completing a traversal of one Web site, Web printer 17 uses tree manager 41 to compare the 
sites remaining in personal-news-profile 1 9 with the site organization information in the extracted data tree to determine 

15 if more sites need to be visited. In the case that more Web sites need to be visited, step S71 0 returns flow to step S706 
and news articles are retrieved in the same manner as discussed above. On tiie other hand, if all of the Web sites listed 
in personal-news-profile 19 have been visited and all of the articles retrieved, flow proceeds to step S801 in Figure 8. 

Flattening and Formatting tiie Retrieved Data 

20 

Rgure 8 is a flow diagram showing how the extracted data tree is flattened and fbrnfiatted. The configuration of the 
invention is the same as when retrieving data from the Web (shown in Figure 6). In fact the flattening arkd formatting 
processes can occur, at least to a limited extent concurrentiy with the data retrieval process. 

In step S801 of Rgure 8. tiie extracted data tree is flattened. This simply means ttiat the organization of the data is 
25 converted from an extracted data tree to a linear document. This step provides the opportunity for excluding more data 
from tiie personalized newspaper, for example by only including nodes of tiie data tree into the flattened document This 
exclusion process is controlled by the flattening rules in personal-news-prof ite 19. 

After the data is flattened into a linear document, tiie data is formatted in step S802 according to the template indi- 
cated in personal-news-profile 19. The definition of ttiis template, which is eitiier a pre-defined tenrplate or a custom 
30 template, was discussed earlier. Finally, in step S803. the formatted and fully personalized newspaper is sent to output 
interface 40. This interface could be printer interface 10 to printer 7, display interface 1 1 to display 2, or even modem/fax 
interface 6; 

Second Embodiment: The HTML Formgt t ^ 

35 

The second embodiment of the invention is a system for processing a hypermedia document. The system 
accesses the hypermedia document, extracts addresses from the hypermedia document, and stores the addresses 
extracted from tiie hypermedia document in a container. The system activates a processing function to process data 
stored at the addresses stored in tiie container, downloads the data stored at the addresses stored in the container into 
40 a memory, and extracts predetermined data from downloaded data in accordance wrtii predetermined configuration 
information. The predetermined data is ttien formatted in accordance witii predefined formatting settings to generate a 
formatted document, and tiie formatted document is processed in accordance wrtii tiie processing function. 

The second embodiment of the invention is depicted as HTML formatter 18. noted in Figure 2. An example of HTML 
formatter 18 is WebFormatter, manufactured by Canon Information Systems. Inc. The second embodiment will be 
45 described with respect to WebFormatter. It should be noted, however, that HTML formatter 18 is not limited to the Web- 
Fomiatter embodiment, and that various alternative embodiments within the sif^rii and scope of tiie following desaiption 
are possible. 

WebFormatter is stand-atone utility software that can be used in conjunction wrtii different Web browsers, such as 
Netscape. Mosaic and Internet Explorer. In short WebFormatter extracts data from a Web page, strips out extempora- 
50 neous data from tiie extracted data, and refbmriats the data into a fomnatted document The formatted document can 
then be printed, stored in an RTF (Rich Text Format) file, or edited in any RTF conrpatible editor, such as MS Word. 
WordPerfect, Wordpad, etc. 

WebFormatter can be activated from a windowing environment such as Microsoft WirxJows®. From such a win- 
dowing environment. WebFormatter can be activated by double-clicking on a WebFormatter icon (not shown) in a start- 
55 up window, selecting WebFormatter from the Windows start menu, dragging a URL (uniform resource locator) icon (not 
shown) from a Web browser and dropping it into the WebFormatter icon, or by automatically invoking WebFormatter 
when the Web browser is started. 

Unlike the first embodiment of the invention described above. WebFormatter does not use a predefined personal- 
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news-profile to specify criteria for creating a particular type of document from one or more Web pages. Rather, Web- 
Formatter relies upon user-spectf ied criteria to create a particular type of document, such as a newspaper or the like, 
from one or more Web pages. These aiteria are input interactively by a user via a graphical user interface; 

As described in more detail below, WebFormatter operates in two modes - a minimized nrxxle and a fully-functional 
mode. In the minimized mode, WebFonnatters graphical user interface is essentially a floating print button, which is dis- 
played concurrently with displayed Web pages. By virtue of this feature, as a user explores the Web, the user can proc- 
ess, format, and print out Web pages by merely clicking on the floating print button. 

In its fully-functional mode, WebFormatter's graphical user interface provides spaces for a user to enter a URL 
address of a W^ page to be processed, enter a personal title for the document, select a format for the document, pre- 
view a formatted first page of the document, and either print the document, save the document as an RTF file, or 
view/edit the document using an RTF editor. The graphical user interface for the fully-functional mode will be described 
first, since it is from that interface that the user can enter the minimized nrrode. 

Rgure 9A shows graphical user interface 43 for WebFormatter^s fully-functional nxxJa Graphical user interface 43 
Is displayed on display 2 upon first activation of WebFormatter. As with any interactive windowing software application, 
a user interacts with graphical user interface 43 by means of mouse 4 (by pointing and clicking) and keyboard 3. 

As shown in Rgure 9A. graphical user interface 43 includes fields 44 and 46 to 49, through which a user can specify 
the URL address of a document to be formatted and the format of that document. Beginning with URL fidd 44, a user 
enters the URL address (e.g., httpy/www.ds.canon.com/lis/tis_home.htm) of a Web page to be processed by WebFor- 
matter. Ttiere are several different ways for the user to enter the URL address. The user can (1) type the address 
directly into URL field 44. (2) copy the URL address in the Web browser and paste the URL address into URL field 44. 
(3) drag the URL address from the Web browser onto graphical user interface 43 or onto the WebFonnatter icon, or (4) 
click on Current URL button 54. 

Witii regard to Current URL button 54, if a user clicks on Current URL button 54. WebFormatter locates the active 
Web browser and queries the Web browser for the address of the cunrent Web page. TTiereafter, the Web browser pro- 
vides the address of the current Web page to WebFonnatter, which places the address in URL address field 44. If URL 
button 54 is activated and no Web browser is currently running. WebFormatter displays dialog box 56, shown in Rgure 
9A. 

As shown, dialog box 56 includes Cancel button 57 and Launch Browser button 59. Cancel button 57 cancels a 
user^s request to input a URL address into URL address field 44 vfa Current URL button 54. Uunch Browser button 59. 
on the other hand, launches a Web browser specified in WebFormatter. As noted below. WebFormatter is configured 
beforehand with predefined infonnation including a Web browser to be used witti WebFormatter. Configuration of Web- 
Formatter will be described in more detail below. 

In alternative embodiments of WebFormatter, a filename can also be entered into URL address field 44. For exam- 
ple, in these alternative embodiments, if a user wishes to format a hyper-linked nrmnual into a book-like format, the user 
enters the filename into URL address field 44. Thereafter. WebFormatter proceeds through the file in the same manner 
as through specified Web pages in order to reformat the hyper-linked manual as desired. 

Returning to graphical user interface 43. title field 46 enables a user to enter a personalized title for a formatted doc- 
ument The title may be typed directiy or pasted into titie f ieW 46. 

Formatting f ieWs 47 to 49 define the format of a document to be output by WebFonnatter. Options for the different 
fornrratting f iekJs can be accessed by clicking on a saoH bar, such as scroll bar 55, of a respective formatting field. Each 
of tiiese f lekls is described in detail below. 

Styles f iekJ 47 provides four options for formatting an output document These styles relate to characteristics of an 
output document such as size of headers, margins, etc. The style options include Contemporary, Fonml, Fun and Pro- 
fessional. The invention, of course, is not limited to these four style options, and otiier styles can be added as desired. 

Columns field 48 defines the number of columns in a formatted output document. Two columns options are availa- 
ble - Single and Multiple; however, the inventton is not limited to these two options. The Single option, as might be 
expected, famats the document into a single column. The Multiple option, on the otiier hand, fbnmats the document into 
a predetermined number of columns. In preferred embodiments of the invention, the multiple option is set to two col- 
umns; however, any number can be set 

Spacing f ieW 49 defines ttie spacing between lines in a fomratted output document. Three options are provided in 
WebFormatter, but other options can be added as desired. These three options are Condensed. Normal and Easy To 
Read, with Condensed being tiie least amount of spacing between lines and Easy To Read being the most amount of 
spadng between lines. 

Graphical user interface 43 is also provided with Preview button 60. By clicking on preview button 60, a user can 
preview a first page of a formatted document in viewing area 61. An example of a previewed formatted document is 
shown in Rgure 9A. 

As shown in Figures 9A ^nd 9B. WebFormatter also includes Options button 61 . Options button 61 provides a user 
with additional formatting options which are used by WebFormatter to create a formatted document. A user can activate 
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Options button 61 by clicking thereon. This causes Options dialog box 62, shown in Rgure 9B. to appear on display 2. 

As shown in Figure 9B, options dialog box 62 includes General options 64, Container options 66 and Strip Meta 
Info options 67. General options 64 includes Text only" listbox 72. "Index of links in the page" listbox 73. and "No f bat- 
ing pictures" listbox 74. These options are indicated as being selected by a check nrark or the like in a respective listijox. 
5 As will become clear from their desaiptions, more tiian one of the options in Genera! options 64 can be selected at the 
same time. 

Text only" llstiDox 72 instructs WebFormatter to strip alt graphics in a Web page and print only text therein. "Index 
of links in the page" listbox 73 instructs WebFonnatter to add a list of all URLs present in a Web page or pages to the 
end of a formatted document. Preferably, tiie list of URLs is printed as supersaipt, and anchor positions of the URLs in 

10 the list are marked in bold. "No floating pictures" listtjox 74 instructs WebFormatter to print all images in the document 
in a particular area of ttie formatted document. In some cases, therefore, when this option is selected; WebFormatter 
shrinks images, as needed, so that images fit into a particular area. 

Strip Meta Info options 67 provides engineering options which facilitate stripping off unnecessary information from 
a Web page being processed by WebFormatter. The options include (1) "None", which instructs WebFormatter to strip 

15 nothing from tiie Web page, (2) "Till tiie first horizontal rule", which instructs WebFonnatter to strip all links and images 
until and up to predefined first and second horizontal formatting rules (e.g.. tp until a horizontal line across a page), and 
(3) "Till the first text", which instructs WebFormatter to strip all links and images up to first and last occurrences of text 
in ttie Web page. Only one of Strip Meta Info options 67 can be selected at a time. Selection thereof is indicated by a 
dot in a bullet located next to an option, as shown in Rgure 9B. 

20 Container options 66 provides options for processing documents, addresses for which are stored in container 76 
shown in Figure 9B. Prior to describing Container options 66, a description of container 76 will be provided. 

As noted, container 76 stores URL addresses of selected documents. Document addresses which are input to fieW 
44 are added to container 76. The order in which URLs are input into container 76 denotes tiie order in which data in 
the URLs is processed by WebFormatter. As shown in Rgure 9B. once container 76 becomes full, its icon changes to 

25 that shown by reference numeral 77. 

When a user clicks on ttie icon for container 76. menu 77 is displayed. Menu 77 provides five options; i.e., Open 
79. Empty 80. Print 81 . Edit 82 and Save 84. These options are highlighted when activated, and are described in detail 
below. 

Open 79. when activated, displays Container Contents screen 87 shown in Rgure 9B. Container Contents screen 
30 87 shows the URL addresses stored in container 76. Container contents screen 87 provides four buttons; i.e.. Add cur- 
rent URL button 88 which adds the current URL to container 76. Delete button 89 which permits a user to highlight and 
delete a URL in container 76. Empty button 90 which permits a user to empty container 76, and Done button 91 which 
permits a user to close Container Contents screen 87. It is noted tiiat a user can also enpty the contents of container 
76 by clicking on Empty 80 of menu 77. 
35 In addition, the user can rearrange the order of URLs stored in container 76 by dragging and dropping different 
URLs at different locations therein. As noted above, since tiie URLs are processed in the order ttiat they appear in con- 
tainer 76. tills feature permits a user to reanrange the processing order of tiie URLs in container 76 interactively. 

Print 81 , Edit 82 and Save 84, when activated, cause WebFormatter to download all data at Web pages defined by 
the URLs stored in container 76. formal tiiem as specified by ttie user, create RTF file(s) storing ttie formatted Web 
40 pages, and do the selected action, i.e.. save, edit or print the RTF file(s). This process is described in greater detail 
below. 

Refen-ing back to Options dialog box 62. Container options 66 include "Print table off contents" listixix 92 and 
"Empty after processing" listiDox 94. As shown, a check mark appears in a listiwx to indicate that the listiaox has been 
selected. In ttiis regard, more than one listbox can be selected at a time. "Print table off contents" listbox 92. when 
45 selected, insft-ucts WebFormatter to print tities off all URLs in container 76 as a table off contents in a fonnatted output 
document. "Empty after processing" listbox 94, when activated, instructs WebFormatter automatically to empty con- 
tainer 76 after printing, editing or saving a document, without waiting for a user to do so. 

Also shown as part off Container options 62 are Select RTF Editor button 69. Cancel button 70 and OK button 71 . 
By clicking on Select RTF Editor button 69. a user can select an RTF ffile editor, examples of which are noted above. 
50 This can be done, for example, by displaying anottier diatog box listing predefined RTF editors (not shown) and select- 
ing one of tt)e predefined RTF editors. Cancel button 70 cancels Container options 62 and OK button 71 confirms 
selected options in Container options 62 and then closes its dialog box 

As shown in Rgure 9B, graphical user interface 43 also includes print icon 96. edit icon 97. save icon 99, help but- 
ton 100, done button 101 and minimizing icon 102. A user may select any of these features by clicking thereon using a 
55 mouse. 

Print icon 96 opens a print dialog box (not shown), which allows a user to print any number of copies of Web pages 
formatted by WebFormatter. Edit icon 97 opens an RTF file storing formatted Web page(s) for editing by a predeter- 
mined RTF editor. Save icon 99 opens a save dialog box (not shown), which allows tiie user to name and save a fbr- 
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matted Web page as an RTF file. Help button 100 provides help messages for operating WebFormatter, and Done 
button 101 exits from WebFormatter. Minimizing Icon 102 activates the minimizing mode of Webformatter which was 
mentioned above and which is described in greater detail below. 

Figure 9C shows menus provided by WebFormatter during its operation. These menus include file menu 103, edit 
menu 104 and window menu 106. File menu 103 provides "Save", "Edit" and "Print" options, the functions of which are 
identical to those of Save icon 99, Edit icon 97 and Print icon 96, respectively. An "Exit" option is also provided to exit 
from File menu 1 03. Finally, File menu 1 03 provides "Open HTML file" option 1 07. This option provides a user with the 
capatHlity to open a local HTML file; i.e., a hypermedia file resident on the user's computer such as a file saved from 
NetScape, or URL files aeated by dragging and dropping a URL onto the windows desktop. "Open HTML file" option 
107 also provides hooks needed to open files created by other Web-file-processing products so that those files can be 
formatted as RTF files and printed, saved and/or edited using WebFormatter. 

Edit menu 104 provides "Paste URL" option 109. "Paste URL" option 109 pastes the contents of a paste buffer, 
such as a URL address copied from a Web page, into URL field 44, as desaibed above. 

Window menu 1 06 provides a "Help Topics" option which provides a user with information regarding the use. main- 
tenance and background of WebFormatter. and an "About WebFormatter option which provides a user with a dialog 
box (not shown) containing WebFormatter's version number and copyright notice(s)- Window menu 106 also includes 
"Preferences" option 1 1 0. "Preferences" option 1 1 0 opens preferences dialog box 1 1 2. shown in Figure 9D. 

Preferences dialog box 112 is used to configure and re-conflgure WebFormatter. As shown in Rgure 9D. prefer- 
ences dialog box 1 12 Includes Minimize view options 1 1 3. General options 1 1 4 and WWW Browser to use options 1 1 5. 
Minimize view options 1 13 can be set to configure WebFormatter's graphical user interface in tiie minimized mode. Two 
sets of options are provided. The first set include "Print". "Edir and "Save". These options correspond to print icon 96, 
edit icon 97 and save icon 99. shown in Rgure 9B. When a check mark appears in a listbooc next to one of these options! 
the icon for tiiat option Is displayed in tfie minimized mode, e.g., the print icon, the edit icon and/or tfie save icon. More 
than one option can be selected at once. In this regard. Rgure 9E shows graphical user interface 1 16, which is a rep- 
resentative example of a graphical user interface for WebFormatter when WebFormatter is in the minimized mode. 

Referring back to Rgure 9D. Minimize view options 1 1 3 also include "Row" and "Stack" options. These options can 
be set to display WebFormatter's graphical user Interface in the minimized mode horizontally by selecting "Row" or ver- 
tically by selecting "Stack". Only one of these options can be selected at a time. As an example of the foregoing, graph- 
ical user interface 1 1 6 con^esponds to a row of icons. 

WWW Browser to use options 1 15 determine which World Wide Web browser is to be used with WebFormatter. As 
shown, preferably NetScape, Internet Explorer and Mosaic are provided as browser options; however, other browser 
options can also be provided. As might be expected, only one of these options can be selected at a time. The default 
browser option is NetScape Navigator. 

General options 114 include "Auto-start with browser" option 117. "Open in minimized view" option 118. "Warn 

before printing more ttian pages" option 1 19. and "Warn before saving more than MBs" option 120. "Auto-start 

with browser option 1 1 7 sets WebFormatter to be invoked automatically when a Web browser is activated. If this option 
is not selected (which is the default). WebFormatter is opened by double clicking on a WebFormatter icon in the win- 
dowing environment, selecting WebFormatter from the Windows start menu, or dragging and dropping a URL from the 
Web browser into ttie WebFormatter icon, as described in more detail above. "Open in minimized view" option 118, 
when selected, opens WebFormatter in minimized mode. The default, however, is the fully-functional mode. "Warri 

before printing more than _ pages" option 1 19. and "V\farn before saving nwe than MBs" option 120 allow a user 

to control tiie number of pages saved of a formatted document and the amount of memory space used by those pages, 
respectively. The default for botfi of tfiese options is for no warning to be given. As is evident, more than one of the gen- 
eral options can be selected at tiie same time. 

Preferences dialog box 1 12 also includes cancel button 121 which cancels a user's selected preferences and OK 
button 122 which confirms a user's selected preferences. 

As explained above. W^Formatter can be configured to enter directiy into the minimized mode via Preferences 
dialog box 112. or a user can enter the minimized mode via minimizing icon 102 shown in Figure 9B. As also noted 
above. Figure 9E shows an example of graphical user Interface 1 1 6 for WebFormatter in the minimized mode. Graphical 
user interface 1 16 is dispfayed as a floating interface while a user is exploring the Web. Thus, as a user views a Web 
page, the user also views graphical user interface 1 16. By clicking on an appropriate icon on graphical user interface 
1 16 (which, in Rgure 9E, includes icons identical in both sti-ucture and function to ttiose shown in graphical user inter- 
face 43), ttie user can capture the current Web page, process and format the Web page into an RTF file, and save, edit 
and/or print ttie RTF file. Alternatively, the user can drag a URL from ttie Web browser and drop it into one of ttie icons. 

A user can reconfigure WebFormatter in tfie minimizing nuxle by double clicking a right mouse button. This action 
causes a preferences dialog box to appear on display 2 which is identical to preferences dialog box 1 12. Thereafter, tfie 
user can alter ttie configuration of WebFormatter as desired. Should a user wish to enter ttie fully-functional mode from 
the minimizing mode, the user need merely click on maximizing icon 117 shown in Figure 9E. 
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Rgure 10 is a ftow diagram describing the operation of WebFormatter. WebFormatter is activated in step S1000. 
As described above, this can be done by double-didQng on a WebFormatter icon in a windowing environment Depend- 
ing upon how WebFormatter has been configured, i.e., in the fully-functional mode or tiie minimizing mode, either a 
graphical user interface similar to that of graphical user interface 43 or one similar to that of graphical user interface 1 1 6 
is displayed in step S1000. For tiie sake of completeness, the following assumes that a graphical user interface similar 
to that of graphical user interface 43 is displayed in step SIOOO, since the default mode of WebFormatter is the fully- 
functional mode. 

Next, in step S1001 , WebFormatter is configured, as descriljed above via preferences cfialog box 1 12 and options 
dialog box 62. This step is not necessary unless a user wishes to change WebFormatter's previously set configuration. 
In step SI 002, document format data is input in fields 44 and 46 to 49 described above. More specifically, the user 
inputs a URL (or filename in alternative embodiments) into URL field 44. As described below, WebFormatter uses this 
information to process Web pages stored at the URL to aeate an RTF file based on the configuration of WebFamatter 
and the data irput in fields 46 to 49. 

In step SI 003, a Web reader similar to that of Web reader 34 described above is executed. The Web reader con- 
nects to a network, such as the WorW Wide Web, in step S1004. 

Next in step S1005, it Is determined whether a URL or a filename has been entered. As described above, in pre- 
ferred embodiments of WebFormatter, only a URL may be entered. However, since alternative errtKxiiments of Web- 
Formatter may permit entry of a filename, a desaiption of processing a file other than one at a URL address will be 
provided. 

If a URL has been entered in fieW 44, processing proceeds to step S1006. In step S1006, tiie Web reader accesses 
the hypermedia document (e.g., a homepage) specified by the URL address. In step SI 007. WebFormatter instructs 
the Web reader to traverse the hypermedia document Thereafter. WebFormatter selects URL address(es) from the 
Web and stores tiie addresses in container 76. Once all desired addresses have been selected and a processing func- 
tion, such as print, has been activated, WebFormatter downloads data stored at tiie addresses in container 76 into 
memory 5. WebFormatter tfien extracts predetermined data from tiie downloaded data based on the configuration infor- 
mation set in Optional dialog box 62. and stores the extracted data in memory 5. Thus, for example, if Text Only" c^on 
72 in Options Window 62 is on. only text Is extracted from the downloaded data. Processing tiien proceeds to step 
81011. 

On the otiier hand, if, in step S1005. a filename for an HTML source file is entered, WebFormatter instructs the Web 
reader to access a first site in the file. In steps SI 008 and SI 009. the site is traversed and data is extracted and stored 
in the same manner as in step S1007. described above. Then, in step S1010, WebFormatter determines if more sites 
are listed in the HTML source file. If more sites are listed in the file, flow returns to step S1008, and the next site is 
accessed. If no more sites are present, processing proceeds to step SI 01 1 , 

In step S101 1 , WebFormatter processes tiie extracted data in accordance wrtti the previously set fonnat informa- 
tion. For example, if Columns field 48 is set to multiple, tiie extracted data vwll be formatted into a document having mul- 
tiple columns. The above processing is initiated by activating one of Print icon 96, Edit icon 97 or Save icon 99, and is 
similar to the processing desaibed above in the first embodiment, e.g.. flattening ttie document and formatting the doc- 
ument based on the formatting information. Accordingly, a detailed description tfiereof is omitted for the sake of brevity. 

Once ttie documents wrhose URLs are stored in the container have been downloaded, fonratted according to the 
preset formats and configurations, and converted into RTF f tle(s) in step SI 01 1 . in step S1012. the RTF file(s) are out- 
put Alternatively, the RTF files(s) can be edited or saved, depending upon which foon on ttie graphical user interface 
has been activated. 

The invention has been desaibed witii respect to particular illustrative embodiments. It is to be understood that ttie 
invention is not limited to tiie above described embodiments and modifications ttiereto, and that various changes and 
modifications may be made by tiiose of ordinary skill in ttie art without departing from ttie scope of tfie appended claims 
as defined in the appended claims. 
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SAMPLE USER PROFILE 

The User Profile is implemented in windows.ini file 
format. 

[Defaults] 
Count=4 

Title=My Daily Paper 
[1] 

Heading-News In Brief 
Site=l 

Section=Front Page 

MaxLevels=5 

Maxpages-10 

MaxKBy te s=2 0 0 0 

Date=today 

Print=level 0 

Template=l 

[2] 

Heading=Sports In Brief 
Site=2 

Section=Sports 
Max- Levels=0 
MaxPages=10 
MaxKbytes=200 

KeywordFilter="Football" AND "49ers" 

Date=today 

Print=level 0 

Teroplate=l 

[3] 

Heading=Money Matters 
Site=l 

Section=Business 
MaxLevels=l 
MaxPages=ipo 
MaxKByt es=2 0000 

KeywordFilter="Computer" OR "hardware" OR 

"Software" 

Date=today 

Print=all 

Template=2 

[4] 

Heading=Sri Lanka 
Site=3 

Section=HotNews 

MaxLevels=l 

MaxPages=100 

MaxKBy tes=2 0 000 

Date-today 

Print=leaves 

Template=2 



14 



EP0 834 822 A2 



SAMPLE SITE PROFILES 
#Legend: 

/%W-day of the week 
#%s-section part of URL 

[Defaults] 
Count=3 

[1] 

Title=»San Jose Mercury News 

Userna]ae==i&wickrain 

Password^cannon 

StartDatanStartHeadlines 

EndData«EndHeadlines 

Home Page^http : / / www . s jmercury . com/ ^ 

Sect ionURL»http : / /www . s jmercury • com / % S . htm 

SectionCount«9 

Section l«Front Page 

Section 2sintemational 

Section 3«=National 

Section 4«Local & Stat^ 

Section 5«Editorials Commentary 

Section 6=Business 

Section 7«Sports 

Section 8«Living 

Section 9=Entertainment 

[1. Sections] 

Front Page=front 

International=intl 

Nationalenatl 

Local & State=>loc 

Editorials & Commentary=edit 

Business=biz 

Sports^spts 

Living=liv 

en tert a inment=ent 

[2] 

Title=The San Francisco Chronicle 

Home Page=http: //www. sf gate, com/chronicle/ ^ 

SectionURL=="http: www. sf gate . com/cig- 
bin/chronicle/ article- 
list. cgi?%/S: /chronicle/today" 

Section Count-5 

Section l^News 

Section 2==Business 

Section 3=Sports 

Section 4=Editorial 

Section 5=Datebook 
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[2 .Sections] 
NewssN6Vs:MN 
Buslness-Business : BU 
Sports»sportG : SP 
Editorlal-Editorial : ED 
Datebook=Datebook : DD 



[3] 

Title«The Day News 
Home page" 

http : / /www. landa . net/ lakehouse/anclWeb/dailynew/ 
Sect ionURL«"http : / /www • lanka . net / lakehouse/anclW 

eb/dailynew/%W/WS .html" 
SectlonCount «12 
Section l^Business 
Section 2=Editorial 
Section 3»Features 
Section 4»Poreign 
Section S^Letters 
Section 6=InBrief 
Section 7BHotNews 
Section 8*=Probe& 
Section 9=Military 
Section 10=Politics 
Section ll^bituaries 
Section 12=Sports 

[3 .Sections] 

Business=business / intro 
Editorial=editorial/final 
Features=features/ intro 
Foreign=f oreign/ intro 
Letters^letters/ final 
InBr ief =inbrief / intro 
HotNewss'hotnews/ intro 
Pr obes=pr oves / intro 
Military=nailitary/ intro 
Pol itics=pol it ics / intro 
Obituaries=obiturai/ intro 
Sport s=sports / intro 
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APPENDIX 2 

SYNTAX FOR RETRIEVAL, EXTRACTION AND PRINTING 
CRITERIA 



Haxlmuxn levels to search: MaxLevels=<#> 
-1: to retrieve all levels 
0-n: to retrieve up to n levels 

Maximum pages of the document: HaxPa9es'=<#> 
n: final document not more than n pages 

Maximum size of the document: MaxKBytes=<#> 

n: document size not more than n kilo bytes 

Exclusion rules: 

Date=today I lessthan <#> 

today: retrieve only articles posted today 
lessthan </>;n: retrieve only articles no 
more than n days old 
Retrieve=all j nosubdir j nothisdir \ thissiteonly 

all: allow to fetch pages from other sites 
nosubdir: exclude URLs to subdirectories 
nothisdir: exclude URLs in this directory 
thissiteonly: fetch pages from this site 
only 

Keyword search: 

KeywordFilter=<keyword> (AND | OR | NOT) <keyword> : 

accumulate only pages containing the 

combination of keywords 
KeywordRank=<#>;n: use fuzzy logic to rank 

pages according to keyword combination in 

KeywordFilter and keep top n ranked pages 
KeywordAuthor=<author>: accumulate only 

pages authored by author 
ExcludeType=ads | nonEnglish 

ads: exclude advertisements 

nonEnglish: exclude articles that are not in 
English 

Flattening rules: Print=all | leaves | level=<#> 

all: include all nodes in the tree in the linear 
document 

leaves: include all leaves in the tree in the 

linear document 
level=<#>;n: include up to nth level of the tree 

in the linear document 

Formatting rules: Template-<#> 

n: print according to default or user template 
number n 



17 



EP0 834 822 A2 



APPENDIX 3 
DESCRIPTION OF MODULES 
Appendix 3A 



THE PERSONAL NEWS PROFILE EDITOR MODULE 



The Profile Editor manages access to the user 
profiles and is represented by CProfileMgr class* 
It also manages loading and saving of the profiles* 
The services provided by Profile Editor are: 

BOOL NewProfile(CString f ileName) ; 

Creates a new profile given the 

file name. 
BOOL OpenProfileQ; 

Open^ the default profile. 
BOOL OpenProfile(CString f ileName) ; 

Opens the named profile. 
CProfileEntry* GetFirstEntryQ; 

Loads and returns the next 

profile entry. 
CProfileEntry* GetNextEntryQ ; 

Loads and returns the next 

profile entry. 
BOOL WriteEntry (CProfileEntry & entry); 

Saves a new entry in the profile. 



Each profile entry contains an extraction 
specification and an output specification as 
represented by CProfileEntry class. The methods 
provided are: 

CURL GetSiteldO; 

Returns the site id contained in 
the profile entry. 

CExtractionSpec GetExtractionSpecQ ; 

Returns the extraction 
specification contained in the 
profile entry. Extraction 
specification contains keywords 
for searching, limits for levels, 
pages, size in kilo bytes. 

COutputSpec GetOutputSpecQ ; 

Returns the output specification 
contained in the profile entry. 
Output specification contains 
formatting instructions and tree 
traversal rules. 
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THE Web REAOKR MODULE 



CWebPage class abstracts the interface to the 
Internet browser and is representative of the actual 
Web page* It will be responsible for fetching a Web 
page, extracting links or references to other URLs 
in the Web page, and maintaining the contents of a 
Web page. The methods provided are: 

BOOL LoadQ; 

- Fetch the Web page using the URL, 
username and password. 

BOOL ParseQ; 

- Parses the data in the Web page 
and creates a list of links. 
Also resolves the relative URLs 
into absolute URLs. 

CURLList* GetLinksO; 

- Returns the list of links in the 
Web page, 

CPageData* GetDataQ; 

Returns the actual text data 
contained in the Web page. 

void FilterContentO; 

Extracts title and other 
information according to the site 
data. 

CString GetTitleQ; 

Retxirns title and other 
information according to the site 
data. 

CString GetAuthorQ; 

- Returns the author of the Web 
page . 

int GetSizeQ; 

- Returns the size of the data in 
kilo bytes. 



CNetwork class will encapsulate OLE functionality 
and provides communication with the Internet 
browser . 

CString GetUsernameQ; 

- Determine the currently set 
username. 

void SetUsername(LPCTSTR) ; 

- Set the current username in the 
CNetwork object. 
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CString GetPasswordQ; 

Deteinaine the currently set 

password, 
void SetPa86Word(LPCTSTR} ; 

- Set the current password in the 
CNetwork object « 

void CloseQ; 

Disconnect any active connection 

and reset the CNetwork object » 
short Read(BSTR*pBuffer, shortiAmount) ; 

Read data retrieved by the 

Browser » 

long GetStatusQ; 

- Query the status of the current 
load. 

BOOL Open(LPCTSTR pURL, shortiHethod, 
LPCTSTR pPostData, long IPostDataSice, 
LPCTSTR pPostHeaders) ; 

Initiates the retrieval of a URL 

from the network. 
CString GetErrorHessageQ ; 

Provide the caller with 

internally generated error 

messages, 
short GetServerStatusQ; 

Determine the error status 

reported by the server, 
long GetContentTypeQ ; 

Return the content length (total 

amount of bytes) of the current 

load. 

CString GetContentEncodingQ ; 

Return the MIME encoding of the 
current load. 

CString GetExpiresQ; 

Return when the data retrieved by 
this load is no longer considered 
valid. 

CString Resolve (LPCTSTR pBase, LPCTSTR 
pRelative) ; 

Generate an absolute (fully 

qualified) URL. 
BOOL IsFinishedO; 

Determine if a load is complete, 
short BytesReadyO; 

- Inform the caller of the number 
of bytes prepared to be read. 
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THB SITE DRIVER MODULE 

The Site Driver will provide the site information to 
the Web Reader. The Site Driver is functionally 
similar to the Profile Editor and is represented by 
CSiteDriver class. Services provided are: 

BOOL NewProfile(CString filename); 

Creates a new profile given the 
file name. 

BOOL OpenProf ileO; 

Opens the default profile. 
BOOL OPenProf ile(CString f ileName) ; 

Opens the named profile. 
CSiteProfile* GetFirstSiteQ ; 

- Loads and retxirns the first site 

entry. 

CSiteProfile* GetNextSiteQ; 

Loads and returns the next site 
entry. 

BOOL WriteEntry (CSiteProf ile& entry); 

Saves a new entry in the profile* 

int NumberOfSitesQ; 

Returns the number of sites 
specified in the profile. 



An entry in the site profile will contain 
information about the base URL of the site, title of 
the news source, information about how to access the 
site, and various other information such as section 
data etc. and will be represented by CSiteEntry 
class. Methods provided are: 

CString GetURLQ; 

Returns the base URL of the site. 
CString GetUsernameQ ; 

- Returns the username for the 
site. 

CString GetPasswordQ ; 

Returns the password for the 

site. 
CString GetTitleQ; 

Returns the password for the 

site. 

CString GetTitleQ; 

- Returns the title of the news 
source. 

int SectionCountQ; 

Returns 
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Appendix 3B 

TREE MANAGER MODULE 



Tree Manager will maintain the most central data 
structure in this program, which is a tree of Web 
page nodes and is represented by the CPageTree. 
CPageTree will traverse the WWW to retrieve the 
necessary Web pages according to the extraction 
specification and builds the tree. The methods 
provided are: 

CPageTreeNode* GetRootQ; 

Returns the root node of the 
tree . 

BOOL Bui Id (CURL URL, C£xtractionSpec& 
spec) ; 

- Builds the tree according to the 
personal news profile extraction 
specification • 



Each node in the page tree is represented by a 
CPageTreeNode. Methods provided are: 

BOOL AddChild(CWebPage* page); 

Adds a child node with Web page 
data. 

CWebPage* GetPageQ; 

- Retxirns the Web page contained in 
the node. 

int NumberOfChildrenQ; 

- Returns the number of children 
belonging to the node. 

BOOL IsLeafO; 

Returns TRUE if a leaf node, 
i.e., no children. 



To traverse the Web page tree, a CTreelterator class 
is defined with different traversal methods. 
Methods provided are: 

void ResetQ; 

- Cancels the current transferral, 
and initializes state data. 

CPage TreeNode* GetNextNodeQ ; 

- Returns the next node in the tree 
in a depth first search. 
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CPage TreeNode* GetNextSiblingQ; 

Returns the nejct node in the tree 
in a breadth first search. 

CPage TreeNode* GetNextLeafQ; 

Returns the next leaf in the tree 
in a depth first search* 



THE FORMATTER MODtTLE 



Input to this module will be the Web page tree 
created by the Tree Manager and the output 
specification contained in the user profile. 
Formatter will traverse the tree according to the 
rules specified in the output specification and the 
final document will be formatted using the 
formatting instructions in the output specification 
and the formatting contained in the Web pages such 
as headings, paragraphs and lists etc. 



The output document will be in Rich Text Format 
(RTF) and will be accessible by many applications. 
RTF is^ advanced formatting language for text, 
providing doctuaent, section and paragraph 
formatting, style sheets, headers and footers, and 
with support for Uniconde. Image formats supported 
are DIB, DDB, WMF, OS/2 metafiles. There is no 
support for Web images which are of the GIF format. 
A third party library will need to be purchased in 
order to do the conversion of the GIF to DIB format 
or one can be developed in-house. 



The prototype creates a HTML file as the output. 



The formatter is represented by the CFormatter 
class. The methods provided are: 

BOOL OpenHTMLFile(CString f ileName) ; 

- Opens the named HTML file for 
output . 

void CloseHTMLFileO; 

Closes and saves the HTML file. 

BOOL PrintHTML(CPageTree& root, 

C0utputSpec& format); 

Given the root and the output 
specification, traverses the tree 
and prints the contents in the 
. Web pages in HTML format. 

BOOL OpenRTFFile(CString f ileName) ; 

- Opens the named RTF file for 
output. 
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void CloseRTFFileO; 

Closes and saves the RTF file. 
BOOL PrintRTF(CPageTree& root, COutputSpec& 
format) ; 

Given the root and the output 
specification, traverses the tree 
and prints the contents in the 
Web pages in RTF format. 



BOOIr Print (CPageTree& root, C0utputSpec6 format); 

Given the root and the output specification 
at, traverses the tree and prints the 
contents in the Web pages to the default 
printer . 



Claims 

1 . A method for formatting data from at least one hypermedia document comprising the steps of: 

an accessing step to access the at least one hypermedia document; 

a retrieving step to retrieve data from the hypermedia document into an extracted data tree, wherein the data 

is retrieved based on a structure of the hypermedia document; 

a flattening step to flatten the extracted data tree into a linear document; and 

a formatting step to format the linear document into a formatted document. 

2. The method of Claim 1 , further comprising the step of printing the formatted document. 

3. The method of Claim 1 , wherein said hypermedia document is located on the World Wide Web. 

4. The method of Claim 1 , wherein said hypermedia document is located on the Internet. 

5. The method of Claim 1 , wherein said hypermedia document is located on an intranet. 

6. The method of Claim 1 . wherein said accessing step, said retrieving step, said flattening step, and said formatting 
step are performed in accordance with a personal-news-prof ile. 

7. A method of creating a personal-news-profile for retrieving data from a hypermedia-linked conputer network, com- 
prising the steps of: 

accessing the hypermedia-linked conrputer network; 
entering a learning mode; 

traversing sites on the hypermedia-linked computer network with commands; 
extracting at least one rule from the commands; and 
compiling the at least one rule into the personal-newsiarcfile. 

8. The method of Claim 7. wherein the at least one rule specifies structural characteristics of sites for traversing the 
hypermedia-linked computer network. 

9. The method of Claim 8, wherein the at least one rule also specifies content-based criteria for traversing the hyper- 
media-linked computer network. 

1 0. A personalization system for creating a personalization profile for a Web site retrieval data retrieval system, the per- 
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sonalization system c»mprising: 

an input device for inputting data and comnwrds to access the World Wide Web; 
a connection to the World Wide Web; 

5 a memory for storing a Web reader, the Web reader for accessing the World Wide Web via the connection to 

the World Wide Web according to commands from the personalization system; and 
a processor for launching the personalization system in response to a user command, wherein the personali- 
zation system, upon being launched. (1) launches tiie Web reader, (2) accesses the World Wide Web via the 
Web reader, (3) enters a learning mode, (4) sends commands to the Web reader to traverse the World Wide 

10 Web according to user commands, (5) extracts at least one rule from the user commands, (6) compiles the at 

least one rule into a personalization profile, and (7) stores the personalization profile. 

11. A metiiod for retrieving articles from a hypermedia-linked computer network and for formatting the articles into a 
personalized newspaper, the method comprising tiie steps of: 

15 

retrieving a stored personal-news-profile which comprises address data for a site on tiie hypermedia-linked 
computer network, command data for accessing data from the site, and newspaper layout commands; 
contacting the site based on address data stored in the personal-news-profile; 
downloading articles from the site based on command data stored in the personal-news-profile; 
20 flattening the articles into a linear document; and 

formatting the linear document into tiie personalized newspaper according to layout commands stored In the 
personal-news-prof il e. 

1 2. The method of Claim 1 1 , further conprising the step of printing the personalized newspaper. 

25 

1 3. The method of Claim 1 1 . wherein said hypermedia-linked computer network is tiie World Wide Web. 

14. The method of Claim 1 1 , wherein said hypermedia-linked computer network is on the Internet. 

30 1 5. The method of Claim 1 1 , wherein said hypermedia-linked computer network is on an intranet. 

1 6. The method of Claim 1 1 , wherein tiie command data for accessing data includes data for selecting articles based 
on a structure of the site. 

35 17. The method of Claim 16, wherein the command data for accessing data also includes data for selecting articles 
based on a content of the articles. 

18. A World Wide Web site data retrieval system for accessing at least one Web site, for retrieving data from the Web 
site, and for formatting the data into a personalized document, the system comprising: 

40 

an input devfoe for inputting data and commands to access tiie World Wide Web; 

a memory for storing a Web site data retrieval driver which includes a Web reader, stored Web site address 
information, stored Web site commands, and stored format information, wherein the memory also includes 
process steps to connect to a Web site and to issue commands within the connected Web site; 

45 a connection to the Workl Wide Web; and 

a processor for launching the Web site data retrieval driver in response to a user inputting a command to 
access the World Wide Web, wherein the Web site retrieval driver, upon toeing launched. (1) launches the Web 
reader to connect to the Work! Wide Web via saki connection, (2) retrieves the Web site address information 
and Web site commands, (3) instructs the Web reader to access the Web site based on the Web site address 

50 information and Web site commands. (4) downloads Web site data from the Web site based on the Web site 

commands, wherein tiie data is downloaded with reference to a linked list so as to avokJ hypermedia-links that 
form loops and so as to avokJ repetitious downloading of data that has already been downloaded. (5) stores 
tiie Web site data in a linear document (6) repeats steps 1 through 5 until all addresses iri the stored Web site 
address information have been accessed, and (7) formats ttie linear document into the personalized document 

55 based on tiie format information. 

19. The Web site data retrieval system of Claim 18, wherein the Web site address information, the Web site com- 
mands, and the format information stored in tiie memory form a personalized-news-profile. 
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20. The Web site data retrieval system of Claim 1 8» further comprising a printer for printing the personalized document. 

21. The Web site data retrieval system of Claim 18, wherein the personalized document represents a personalized 
newspaper. 

5 

22. The Web site data retrieval system of Claim 18, wherein the personalized document represents a personalized 
magazine. 

23. The Web site data retrieval system of Claim 18, wherein the personalized document represents a personalized 
10 book. 

24. Computer executable process steps stored on a computer-readable medium, said steps for accessing World Wide 
Web sites for retrieving data at the sites and for formatting the data into a personalized document, said steps com- 
prising: 

15 

a connecting step to connect to the World Wide Web; 

a retrieving step to retrieve user-defined Web site address informatics, user-defined Web site commands, and 
user-defined formatting commands; 

an activating step to activate a Web reader so as to access a Web site based on the user-defined Web site 
20 address information and retrieving data from witiiin the Web site based on the user-defined Web site com- 

mands; 

a downloading step to download the retrieved Web site data from the accessed Web site into an extracted data 
tree; 

a flattening step to flatten the extracted data tree into a linear document; 
25 a step to repeat the downloading step and the flattening step until all addresses in the user-defined Web site 

address information have been accessed: and 

a formatting step to format tiie stored data into the personalized document based on the user-defined format- 
ting commands. 

30 25. The computer executable process steps of Claim 24, further comprising a spooling step to spool the personalized 
document to an output device. 

26. The computer executable process steps of Claim 25. wherein the output device is a printer. 

35 27, The conputer executable process steps of Claim 25, wherein the output device is a display 

28, The computer executable process steps of Claim 24, wherein the user-defined Web site convmnds include com- 
mands for selecting data based on a structure of the Web site. 

40 29, The computer executable process steps of Claim 28, wherein the user-defined Web site commands also include 
commands for selecting data based on a content of tiie W^ site. 

30, An apparatus for retrieving news articles from on-line news services on tiie World Wide Web and fbnnatting the 
news articles into a personalized newspaper, the apparatus comprising: 

45 

first storage means for storing (1) a personal-news-profile which comprises addresses data and commemd 
data for accessing data from a Web site, arxl (2) newspaper format commands; 
retrieval means for retrieving tiie stored personal-news-profile and accessing data stored therein; 
activating means for activating a Web reader to contact a Web site based on address data stored in the per- 
50 sonal-news-profile; 

downloading means for downloading news articles from the contacted Web site based on command data 
stored in the personal-news-profile; 

second storage means for storing the downloaded nevre articles; and 

formatting means for formatting the stored news articles into the personalized newspaper based on tiie news- 
55 paper format commands stored in the personal-news-profile. 

31. The apparatus of Claim 30, further comprising spooling means for spooling the personalized newspaper to a 
printer. 
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32. A method for formatting data from a hypermedia document into a personalized document, comprising the steps of: 

a location specifying step to specify a location of the hypermedia document; 
a type specifying step to specify the type of the hypermedia document; 

a scope specifying step to specify the scope of data to retrieve from the hypermedia document, wherein the 
scope is t>ased on a structure of the hypermedia document; 

a format spedfying step to specify a format for formatting the data retrieved from the hypermedia document 
into the personalized document; 

an accessing step to access the hypermedia document found at the location specified in the location specifying 
step; 

a retrieving step to retrieve data from the hypermedia document accessed in the accessing step, wherein the 
data is retrieved in accordance with the type specified in the type specifying step and in accordance with the 
scope specified in the scope specifying step; and 

a fbnnatting step to format the data retrieved in the retrieving step into the personalized document wherein the 
data is formatted in accordance with the format specified in the format specifying step. 

33. The method of Claim 32, further comprising a printing step to print the personalized document. 

34. The method of Claim 32, wherein the location specified in the location specifying step is a filename. 

35. The method of Claim 32, wherein the location specified in the location specifying step is a uniform resource locator 
forthe World Wide Web. 

36. A method of processing a hypermedia document, comprising the steps of: 

accessing the hypermedia document; 

extracting addresses from the hypermedia document; 

storing the addresses extracted from the hypermedia document in a container in a memory; 
activating a processing function to process data stored at the addresses stored in the container; 
downloading the data stored at the addresses in the container into the memory; 

extracting predetermined data from downloaded data in accordance with predetermined configuration informa- 
tion; 

formatting the predetermined data in accordance with predefined fonnatting settings to generate a formatted 
document; and 

processing the formatted document in accordance with the processing function. 

37. A method according to Claim 36, further comprising a step of previewing the formatted document prior to process- 
ing the formatted document 



38. A method according to Claim 37, further comprising the steps of: 



changing the formatting settings after previewing the document and before processing the fomnatted document 
in accordance with the processing function; 
re-activating the processing function; and 

re-formatting tfie data in accordance with changed formatting setting to generate the formatted document 

39. A metiiod according to Claim 36, wherein the addresses are stored in tiie container in ttie order that the addresses 
are Input into the container; and 

wherein ttie processing function processes the predetermined data in the order that the addresses are 
stored in the container. 

40. A mettiod according to Claim 39, further comprising the step of rearranging \he addresses stored in the container 
by dragging and dropping the addresses witfiin the container. 

41. A method according to Claim 36. further comprising a step of inputting the formatting settings and configuration 
information via a graphical user interface. 

42. A metiiod according to Claim 41, wherein the graphical user interface comprises plural processing icons, one of 
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which activates the processing function. 
43. A method according to Claim 42, wherein the graphical user interface is displayed in plural modes. 

5 44. A method according to Claim 43, wherein the plural modes comprise (1) a fully-functional mode in which the graph- 
ical user interface displays formatting fields, processing options, menus and the processing icons, and (2) a mini- 
mizing mode in which the graphical user interlace displays only the processing icons. 

45. A method according to Claim 44, wherein the graphical user interface displayed in the minimizing mode is displayed 
10 during browsing the hypermedia document. 

46. An apparatus for processing a hypermedia document, comprising: 

a Web read which accesses the hypermedia document; 
15 means for extracting addresses from the hypenmedia document; 

a memory including a container which stores the addresses extracted from the hypennedia document; 

a graphical user interface having processing icons which activate at least one processing function to process 

data stored at the addresses stored in the container; and 

processing means which (1) downloads the data stored at the addresses stored in the container into the mem- 
20 ory, (2) extracts predetermined data from downloaded data in accordance with predefined configuration set- 

tings. (3) formats the predetermined data in accordance with predefined formatting settings to generate a 
formatted document, and (4) processes the formatted document in accordance with the processing function. 

47. An apparatus according to Claim 46. further conrprising previewing means for previewing the formatted document 
25 prior to processing the formatted document. 

48. An apparatus according to Claim 46, wherein the addresses are stored in the container in the order that the 
addresses are input into the container; and 

wherein the processing function processes the predetermined data in the order that the addresses are 
30 Stored in the container. 

49. An apparatus according to Claim 48, further comprising dragging and dropping means for dragging and dropping 
the addresses listed in the container in order to rearrange the addresses in the container. 

35 50. An apparatus according to Claim 46, further comprising inputting means for inputting the formatting settings and 
configuration Information via a graphical user Interface. 

51. An apparatus according to Claim 50, wherein the graphical user interface comprises plural processing icons, one 
of which activates to the processing function. 

40 

52. An apparatus according to Claim 51 . further comprising dsplay means for displaying the graphical user interface in 
plural modes. 

53. An apparatus according to Claim 52, wherein the plural modes comprise (1) a fully-functional mode in which the 
45 graphical user interface displays formatting fields, processing options, menus and the processing icons, and (2) a 

minimizing mode in which the graphical user Interface displays only the processing Icons. 

54. An apparatus according to Claim 53, wherein the graphical user interface displayed in tiie minimizing nxxJe is dis- 
played during browsing the hypermedia document. 
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